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Systems and methods for medical diagnostic and for medical guided interventions using multiple imaging systems are introduced. 
These systems and methods recognize the need for a relatively simple and modular way of combining information available from two 
or more medical imaging apparatus in medical diagnosis and in image guided surgery and therapy. Particularly these methods enable 
to minimize mechanical constraints involved in a cooperative operation of several medical imaging devices. The apparatus and methods 
introduced in the present invention enable to measure the relative position between different medical imaging devices and between the image 
planes and/or image volumes produced by them by means of using a position measuring system based with attachable position measuring 
components. This facilitates image fusing when images of the same plane/volume are available from different medical imaging systems. 
Additionally/alternately it enables to position a second medical imaging device over a desired area/volume according to information received 
from the image produced by the first medical imaging device. 
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APPARATUS AND METHODS FOR MEDICAL DIAGNOSTIC AND FOR 
MEDICAL GUIDED INTERVENTIONS AND THERAPY 

CROSS REFERENCES TO RELATED APPLICATIONS 

This PCT Patent Application is related to and claims priority from commonly 
owned U.S. Provisional Patent Application No. 60/ 127,267 filed on March 31, 1999 
entitled: 

APPARATUS AND METHODS FOR MEDICAL DIAGNOSTIC AND FOR 
MEDICAL GUIDED INTERVENTIONS USING MULTIPLE IMAGING 
SYSTEMS. 

This Provisional Patent Application is incorporated by reference in its entirety 

herein. 

FIELD OF THE INVENTION 

The present invention relates to apparatus for performing medical diagnosis, 
and to apparatus for planing and performing medical interventions or therapy 
procedures. Particularly, the present invention is related to apparatus for performing 
guided medical interventions or medical therapy procedures that employ multiple 
medical imaging systems for viewing the target in a body or body volume during the 
intervention. 

BACKGROUND OF THE INVENTION 

During recent years fusing images from different medical imaging systems in 
order to receive a better diagnostic has become widely used. Additionally, the 
cooperative operation of several medical imaging devices can reduce the amount of 

1 
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radiation at which patient is subjected during diagnosis, therapy planning and medical 
procedures and interventions. While these facts have been already recognized, the 
realization of such cooperative operation has been until now generally restricted to 
medical imaging devices having a common mechanical platform. 
5 Additionally, various directional therapy procedures (based on directing an 

energy field towards a target in a body) are assisted by images of said body and target 
produced by medical imaging devices like CT, MR, ultrasound, etc. 
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SUMMARY OF THE INVENTION 

During diagnosis during medical interventions or during therapy procedures, it 
may be necessary or helpful to operate several medical imaging devices simultaneously 
or sequentially. This is done upon necessity and compatibility between the devices, in 
order to indicate the condition of the patient and/or designate a target in a body or 
body volume. For example the same target can be viewed by ultrasound and by some 
other medical imaging device such as a CT, X-Ray, or endoscope imaging device. 

The present invention comprises methods and apparatus for combining two or 
more medical imaging systems (such as an ultrasound and a CT) in medical diagnosis 
and procedures without mechanical constrains between the position of the two or more 
medical imaging devices. The present invention is particularly useful in guided medical 
interventions into a body or body volume, where a target is sought to be evaluated. 
The apparatus disclosed in the present invention comprises at least two medical 
imaging devices for example, an ultrasound, CT, X-Ray, endoscope, at least a display, 
a data processor, and a position measuring system comprising position controlling and 
position measuring components. At least part of the position measuring components 
are located at determined positions with respect to the medical imaging devices and 
calibrated with respect to the image\beam produced by the imaging devices. The 
position measuring system enables the establishment of the relative positions between 
the at least two medical imaging devices. The data processor receiving the information 
from the position measuring system, is also able to establish the position between the 
image planes/volumes produced by the at least two imaging devices and using it for at 
least one of the following; 
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a) maneuvering one or more imaging devices in order to scan the interest 
target within the body according to information available from another medical 
imaging device, or 

b) facilitating image fusing when images of same plane/volume are available 
5 from two or more imaging devices. 

The term position measuring components defines any of the following group: 
transmitter or receiver or reflector or transceiver or optical indicia or inertial sensor or 
any combination of the above, suitable to be part of a position measuring system. This 
position measuring system may be magnetic, acoustic, optic, inertial or a combination 

10 of the above. 

The resultant apparatus enables free-hand manipulation of all or part of the 
medical imaging devices used in the same intervention or diagnosis. 

The apparatus and methods described in the present invention facilitate the 
combination of a number of medical imaging devices to perform various medical 

15 diagnostic, therapy procedures and intervention tasks more safely and efficiently than 
those of the conventional systems. Particularly, the apparatus of the present invention 
enabling viewing of a target with one medical imaging device and guiding a medical 
intervention tool or a medical therapeutic tool, or alternatively inserting a medical 
device when using a second medical imaging device. This can be particularly useful 

20 when employing image guided medical intervention systems such as those introduced 
by the assignees in commonly assigned U.S. Patent No. 5,647,373, entitled: 
Articulated Needle Guide For Ultrasound Imaging And Method Of Using Same, and 
patent applications, PCT/IL96/00050 (WO 97/03609), entitled: Free-Hand Aiming Of 
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A Needle Guide; PCT/IL98/00578, entitled: System And Method For Guiding The 
Movements Of A Device To A Target Particularly For Medical Applications; and 
PCT/IL98/00631, entitled: Calibration Method And Apparatus For Calibrating 
Position Sensors On Scanning Transducers, all four of these documents incorporated 

5 by reference in their entirety herein. 

The apparatus described in the present invention may also reduce the amount of 
radiation applied on a patient during diagnostic and medical interventions and/or 
therapy, for example when using ultrasound and CT in the same intervention. 
The present invention also comprises methods and apparatus for guiding a directional 

io therapy procedure without mechanical constrains between the position of the medical 
imaging device or devices used to assist the therapy procedure and the directional 
therapeutic device. The apparatus therefore, enables free-hand manipulation of part or 
all of the medical imaging devices used to assist the therapy procedure and/or of the 
therapeutic head. The term directional therapy procedure will define any procedure 

15 during which an energy field is directed towards a target or area in the body of the 
patient. This energy field can be ultrasonic or Shockwaves (lithotripsy) , or 
electromagnetic (radiotherapy, laser, etc) or particle beam (proton beam for example). 
The data processor receives the information from the position measuring system and 
uses it for directing the therapy device head\beam towards a desired target in the body. 

20 The method and apparatus are beneficial in that they have add-on capabilities; 

can define dynamic architectures, and enable free-hand maneuvering of all or part of 
the devices employed therein. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

The present invention will now be described by way of the accompanying 
drawings, wherein like reference numerals and/or characters indicate corresponding or 
5 like components. In the drawings: 

FIG. la pictorially illustrates one form of a system constructed according in 
accordance with the present invention for cooperative operation of an ultrasound and a 
computerized topography (CT) apparatus; 

FIG. lb pictorially illustrates the relative position between the scanning beams 
10 of the CT and ultrasound in FIG. la; 

FIG. 2a is a vector diagram which pictorially illustrates the vectors used in 
calculating the relative position between the scanning beams of the ultrasound and the 
CT in FIG la; 

FIG. 2b is a block diagram illustrating the steps involved in calculating the 
15 relative position between the scanning beams of the ultrasound and the CT in FIG la.; 

FIG. 3 pictorially illustrates display functions enabled according to the present 
invention in relation to FIG. la; 

FIG. 4 is a simplified flowchart illustrating the steps of using in a cooperative 
mode two medical scanning devices in accordance to the present invention; 
20 FIG. 5a pictorially illustrates one possible position measuring system to be used 

in accordance to the present invention; 

FIG. 5b pictorially illustrates another possible position measuring system to be 
used in accordance to the present invention; and 
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FIG. 6 pictorially illustrates one form of a system constructed according in 
accordance with the present invention for cooperative operation of an ultrasound and a 
X-Ray: 



7 



WO 00/57767 



PCT/ILOO/00202 



DETAILED DESCRIPTION OF THE EMBODIMENTS 

FIG. la illustrates a first embodiment, exemplary of the present invention. The 
first embodiment utilizes at least two compatible medical imaging devices that produce 
medical images. Here, the medical imaging devices include an ultrasound apparatus 2, 

5 and a computerized tomography (CT) apparatus 4, employed in a cooperative 

operation. Alternately, the medical imaging devices could be the same or different 
devices, or combinations thereof, provided they operate cooperatively with respect to 
each other and are compatible. For example, these devices may be devices that 
produce images by ultrasound, computerized tomography (CT), X-ray, endoscopy etc. 

io In the set-up illustrated in Fig. 1 , for example, images produced by CT 4 of a 

body 6 (or body volume) of a target 8 in the body 6 (body volume) may be utilized to 
position ultrasound transducer 18 at known position with respect with respect to target 
8, even if target 8 cannot be imaged as accurately by ultrasound. This is particularly 
useful in CT assisted medical interventions enabling to use ultrasound images for 

15 real-time monitoring of the invasive tool while using the CT images for primary 
location of the target. Additionally, images produced by the two medical imaging 
devices may be combined in real-time or off-line to produce the detail required in the 
area of the image required. This may also be used for monitoring anatomic changes 
due to breathing or internal movements between the CT images and the situation of the 

20 body 6 at the time of the procedure. The system can be fitted to existing and deployed 
medical imaging devices without major modifications or adaptations. 

Ultrasound 2 and/or CT 4 are connected to a display 10 via an image processor 
12 (optional) contained in data processor 14, for displaying on display 10 at least the 
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images produced by ultrasound 2 and CT 4. Ultrasound 2 and/or CT 4 can also be 
connected directly to display 10 via the necessary connections and hardware. Image 
processor 12 can be part of the data processor 14 or can be connected to it. 

Ultrasound 2 comprises a main unit 17 connected to a scanning head 18 further 
referred to as the ultrasound transducer as is known in the art. CT 4 comprises a main 
unit (CT computer) 20 connected to a scanning head 22, further referred as a CT 
scanning head. CT scanning head 22 includes X-ray emitter and detector(s) (not 
shown) as is known in the art. The term scanning head will be used to define the 
detector and/or emitter component of the medical imaging or scanning device, such as 
the transducer of an ultrasound, or the X-ray emitter and detector(s) of a CT or an 
X-ray or the CCD of an optical endoscope. 

A position measuring system comprising at least a position sensing controller 
26 and position measuring components (PMCS) 28, 30, 32 and 34 is used to measure 
the relative position between ultrasound transducer 18 and the CT scanning head 22. 
The term position measuring components will define any of the following group: 
transmitter or receiver or reflector or transceiver or optical indicia or inertial sensor or 
any combination of the above, suitable to be part of a magnetic (for example, in 
accordance with the systems detailed in U.S. Patents Nos. 4,314,251, 4,054,881) or 
acoustic (for example, in accordance with the system detailed in U.S. Patent No. 
4,124,838) or optic (for example, in accordance with the system detailed in U.S. 
Patent No. 4,649,504) or inertial (for example, 1S900 manufactured by InterSense 
Inc.) position measuring system or any combination of the above, all of the above 
listed U.S. Patents incorporated by reference herein. Also, position levers in 
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accordance with U.S. Patent No. 5, 647, 373 and PCTs PCT/IL96/ 00050, 
PCT/IL98/ 00578, PCT/IL98/ 00578 and PCT/IL98/ 00631, listed above, are also 
suitable. Position sensing controller 26 can be part of the data processor 14. 

In order to perform the task of measuring the relative position between 
ultrasound transducer 18 and CT scanning head 22, position measuring component 28 
is attached at a known and fixed position with respect to the ultrasound transducer 18. 
The attachment can be either directly to the transducer 18 or by means of an extension 
27. Position measuring component 28 is calibrated to ultrasound transducer 18 such 
that the ultrasound beam 36 is at a known and fixed position with respect to position 
measuring component 28. Such calibration can be achieved by operating according to 
PCT application PCT/IL98/00631. 

Position measuring component 30 is attached at a known and fixed position 
from CT scanning head (gantry) 22. The attachment can be either directly to the CT 
scanning head (gantry) 22 or by means of an extension 29. The term position defines 
location and/or orientation. 

Position sensing controller 26 measures the relative position between position 
measuring component 28 and position measuring component 30, enabling to calculate 
the relative position between ultrasound transducer 18 and CT scanning head 22. 
Position measuring component 30 is calibrated to scanning head 22 such that the CT 
scanning beam 34 is at a known and fixed position with respect to position measuring 
component 30. Such calibration can be achieved by operating according to the 
co-assigned PCT application PCT/IL98/0063 1 . 
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Reference is now made to FIG. lb that shows a detailed view of ultrasound 
transducer 18, CT scanning head 22 and position measuring components 28 and 30. 
Items referred to in previous figures are numbered similarly and will not be further 
described. 

Alternately/additionally position measuring component 32 may be attached to 
CT bed 15. The attachment can be either directly to the CT bed 15 or by means of an 
extension 31. In this case position measuring component 34 is attached at a fixed 
position with respect to a reference position of the CT scanning head 22 (for example 
the default perpendicular position), and movements of the gantry 22 are compensated 
according to information available from the CT computer 20. 

An additional position measuring component 34 may be attached at a fixed 
position from CT scanning head attached from the ceiling of the CT room by arm 33. 
In this case position measuring component 34 is attached at a fixed position with 
respect to a reference position of the CT (for example the default position), and 
movements of the gantry 22 are compensated according to information available from 
the CT 20. 

It is not necessary to use position measuring components 30, 32 34 together. 
Rather, it is sufficient to use at least one of them. In order to operate the apparatus 
properly it is sufficient to implement only one of the above position measuring 
components 30, 32 and 34 in combination with position measuring component 28. 
Position measuring components 32 and 34, if used, are calibrated to CT scanning head 
22 similar to the calibration of position measuring component 30, if used. 



11 



WO 00/57767 



PCT/1L00/00202 



Since position measuring component 28 is calibrated to transducer 18 and at 
least one of the position measuring components 30, 32 and 34 is calibrated to CT 
scanning head 22 it is possible to calculate the relative position between ultrasound 
scanning beam 36 and CT scanning beam 38. This is calculated based on measuring 
the relative position between position measuring components 28 and at least one of the 
following: one of position measuring components30, 32 and 34, and based on the 
calibration values defined above. The vector diagram of FIG. 2a and flowchart of FIG. 
2b illustrate one possible algorithm to be used for calculating the relative position 
between the beams of the two medical imaging devices . 

Reference to flowchart of FIG. 2b, block 40 shows the result of the calibrating 
position measuring component 28 to ultrasound transducer 18. Block 42 shows the 
result of the calibrating position measuring component 28 to ultrasound transducer 18. 
Blocks 40 and 42 are generally performed off-line. Block 44 shows the measurement 
of the relative position of position sensor 28 with respect to position sensor 30. Block 
46 shows one possible set of equations (Equations 1 and 2 described below) for 
calculating the relative position between ultrasound scanning beam 32 and CT scanning 
beam 34. These equations are: 

[M] c u T s :s s j =[M& M sV° *M f P j£f 0 *([M]>- S M £ 2 Y (Bq- D 

d mi = [MftsYe 28 * ( Mimi ) T * d £- T M s -y° + 

20 (Eq. 2) 

rw-iP.M_C.28 * ; j P.M.C.28 J P.M.C.28 i 
L ivl JUS.S.B l u P.M.C.30 " u US.S.B I 

The indexes and parameters in the above equations are according to vector 
diagram of FIG. 2a and flowchart of FIG. 2b. It is therefore possible to calculate the 
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relative position of transducer 18 and ultrasound beam\image 36 with respect to a CT 
image or CT set of images. 

Necessary correction due to moving the CT stretcher 16 outside the gantry can 
be performed according to information available from the CT system (the displacement 
of stretcher 16 can be measured with an accuracy of less than 1 
0.25mm to 0.5 mm). The movement of the bed stretcher 16 can be at a predetermined 
value bringing the desired target 6 or CT slice of interest at the same position from CT 
scanning head (gantry) 22. Alternately, the CT stretcher 16 can be moved at any 
desired position. 

Necessary correction due to tilt of the scanning head of the CT 22 may be 
performed according to information available from the CT system 4. 

Necessary correction due to swivel of bed stretcher 16 can be performed 
according to information available from the CT system. 

Necessary correction due to using oblique or perpendicular CT images can be 
performed according to information available from the CT system. 

All the above mentioned correction values can be manually inputted to the data 
processor 14 or transferred through communication links from CT main unit 20 or data 
processor 14 can identify them automatically for example according to information 
generally available in the CT image (video or DICOM form). 

Similar or alternate algorithms can be implemented in connection to position 
measuring components 32 and 34. 

Referring to FIG. 3, the relative position of ultrasound image (scanning beam 
34) with respect to a set of CT images is indicated to the operator on the apparatus 
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display 10. The indications are in 2-D and/or 3-D fashion for example in the form of 
boxes 60, 62, 64, 66. and 68. 

The amount of deviation of ultrasound scanning beam 36 from a reference CT 
scanning image 38 can be displayed to the operator, for example in the from of angles 
and distances, as in box 60, and in the form of side-view illustration box 62, and 
top-view illustration, box 64. This enables the operator to first scan body 6 by CT, 
identify at least one target 8 in body 6, and then position ultrasound transducer 18 such 
as to view a desired CT slice\image. 

Additionally, target 8 can be marked in a CT image and it is possible to 
maneuver ultrasound transducer 18 such as to view the target 8. The indications can be 
in the form of box 66 comprising arrows indicating how to maneuver transducer 18 
and numbers indicating the distance of target 8 from ultrasound scanning beam 36. It is 
then possible, for example, to guide an invasive tool towards target 8 based on CT 
images in combination with real-time imaging of the invasive tool by ultrasound. . 

Boxes 68 and 70 provide information regarding the position transducer beam 36 
with respect to a volume of CT images. Box 68 shows the CT slice (reconstruction) 
aligned with the current position of transducer 18. Box 70 illustrates the relative 
position of transducer 18 with respect to the scanned volume in a sagital view. 

While Fig. 3 illustrated specific display modalities for enabling the user to 
cooperatively use ultrasound 2 and CT 4 information additional or alternate displays 
may be used. 
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In applications requiring very high accuracy it may be necessary to constrain 
body 6 in order to avoid small movements between scanning body 6 by ultrasound 2 
and scanning body 6 by CT 4. In most applications this requirement is not necessary. 

Reference is now made to FIG. 4 which is a flow-chart illustration of the steps 
required in order to operate ultrasound 2 and CT 4 in operative cooperation as 
illustrated in Fig. 1 and in accordance to the present invention. At step 90, it is 
measured the relative position between position measuring components (PMC) 28 and 
30 (FIG. 4). It is possible to use position measuring components 32 or 34 or both 
instead or in addition to position measuring component 30 (as explained above). At 
step 92 it is calculated the relative position between ultrasound scanning 
plane/volume/image 36 and CT scanning plane/volume/image 38. The calculation at 
step 92 is based on the calibration of position measuring component 28 and 30 (32, 34) 
with respect to ultrasound transducer 18 and CT scanner 22 (step 94). The calculation 
in step 94 may also be used in other medical procedures (step 96) that is optional, but 
preferred, for example in image guided interventions, such as described in commonly 
assigned U.S. Patent No. 5,647,373. The calculation in step 92 may also be used in 
order to instruct the maneuvering ultrasound transducer 18 in a required position. 
Once the relative position between the scanning planes/ volume is calculated the images 
from CT system 4 and ultrasound system 2 may be correlated and or fused in optional, 
but highly preferred step 98. This can be performed according to conventional image 
processing algorithms and techniques. By correlating or fusing these images (from the 
ultrasound and CT scanning beams, respectively), the displayed ultrasound image may 
be enhanced. The superimposed image/information resulting of step 98 may be 
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optionally used to improve calculation at step 92 in an iterative mode. The 
superimposed image/information resulting of step 98 may also be used in other medical 
procedures (step 96) or in order to instruct maneuvering of ultrasound transducer 18 
(step 120). 

5 The imaging options 100 are non-exhaustively, listed as follows. The image 

from CT system 4 and ultrasound system 2 may be displayed individually (steps 102 
and 104), the relative position between CT and ultrasound scanning beams may be 
displayed (step 106, illustrated in Fig. 3) and the result of image fusing, at step 98 may 
also be displayed (step 108). Target and image correlation information can also be 

10 available to the operator indicating for example internal anatomic movements as 
explained herein below. 

In addition to and interacting with display functions 100, there are various 
ancillary functions such as optionally marking a target 8 (step 112) on the image 
produced by one of the imaging devices as appearing on display 10. Then the position 

15 of target 8 may be calculated within the scanning beam of the medical imaging device, 
(step 114). Additionally/alternately a reference plane/volume may be marked or 
signaled according to the image produced by one of the imaging device (step 116). The 
position of the reference plane/ volume may then be calculated (step 118). The data in 
steps 1 14 and/or 118 may be optionally used in order to instruct the positioning of CT 

20 scanning head 22 and ultrasound transducer 18 with respect to each other (step 120). 

A specific implementation to be used in connection to the present invention 
regards the use of image correlation in applications where internal organs may 
significantly move between the time the CT scan was performed and the time of 
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performing a procedure. Body volume 6 is scanned by the CT system 4 producing high 
resolution image/information. The operator defines at least one target on CT image as 
displayed on display 10. The same target is then scanned with ultrasound transducer 
18. The position of the ultrasound scanning beam\image 36 is determined (as detailed 
above) with respect to position of the CT scanning beam 38. Additionally, by 
comparing the relative position of target 8 in the ultrasound image with the position 
calculated from the CT image, it is possible to monitor and compensate for internal 
movements or for respiratory changes in body 8 between taking the CT scan and the 
time of performing an intervention. For this implementation it is preferred (but not 
necessary) to mark more than one target/points in the CT image and then locate them 
by ultrasound. This enables to calculate internal anatomic displacements inside body 8, 
between the images produced by the CT and the situation during the time of an 
intervention. The operation defined above can also be performed automatically 
provided enough distinctive targets\points\clusters may be found in the CT and 
ultrasound images. 

Reference is now made to FIG. 5a that illustrates a magnetic position 
measuring system to be used in accordance with an exemplary embodiment of the 
present invention. Similar items in previous figures have similar numbers and will not 
be further described. 

In this exemplary embodiment position measuring component 28 is a receiver 
28' being attached to ultrasound transducer 18 and position measuring component 30 is 
a transmitter 30' being attached to CT scanning head 22 by an arm 80'. Transmitter 
30' is transmitting AC or DC magnetic/electromagnetic signals to receiver 28 \ The 
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output of receiver 28' is transmitted by wire or wireless connections to position 
sensing controller 26 enabling to calculate the relative position of receiver 28' with 
respect to transmitter 30' . Alternately, position measuring component 28 could be a 
transmitter and position measuring component 30 could be a receiver. 

5 Reference is now made to FIG. 5b wherein an optical position measuring 

system is employed in accordance with another exemplary embodiment of the present 
invention. Similar items in previous figures have similar numbers and will not be 
further described. A stereo vision charge coupled device (CCD) camera 84' is 
positioned on an arm 86' at a first reference location. Position measuring component 

10 28 includes a cluster of LED's 28" being attached to ultrasound transducer 18 by an 
arm 88' and position measuring component 30 includes a cluster of LED's 30" being 
attached to CT scanning head 22 by an arm 80' ' . The relative position of cluster of 
LED's 28" is measured with respect to the CCD camera 84' (first reference location), 
and also the relative position of cluster of LED's 30" is measured with respect to CCD 

15 camera 84' (first reference location). It is therefore possible to calculate from the 
above measurements the relative position of cluster of LED's 30" with respect to 
cluster of LED's 28" and hence, the relative position between ultrasound scanning 
beam 32 and CT scanning beam 34. 

The above detailed position measuring systems enable measurement of the 

20 relative position between ultrasound transducer scanning beam 32 and CT scanning 
beam 34 can be optical, acoustic, magnetic or inertial or a combination of the above. 
The relative position between position measuring components 28 and 30 can be 
measured directly, for example, when one of the components is a receiver and the 
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other one is a transmitter as illustrated in the exemplary embodiment in FIG. 5a. 
Alternately, the relative position between position measuring components 28 and 30 
can be calculated indirectly, for example, by measuring the position of each with 
respect to a reference location as illustrated in the exemplary embodiment in FIG. 5b. 
5 When making these indirect calculations, a third position measuring component 

84 (illustrated in FIG. 5b by a stereo Charge Coupled Device (CCD) 84') is in 
operative communication with position measuring components 28 and 30, this CCD 84 
is positioned at a first reference location. The first reference location may be fixed and 
known. Alternately, the first reference position can be movable and unknown. 
10 Optionally, the first reference position can be attached to the bed 24. 

Position measuring components 28, 30 and 84 (if part of the system) may be 
any of the following group: transmitter or receiver or reflector or transceiver or optical 
indicia or any combination of the above. Position measuring components 28, 30 and 84 
(if part of the system) may be part of a magnetic or acoustic or optic or inertial 
is position measuring system or a combination of the above. 

Position sensing controller 26 may communicate with at least one or all of 
position measuring components 28, 30 and 84 (if part of the system) by wired or 
wireless links. 

Reference is now made to FIG. 6, which illustrates an additional embodiment 
20 of the present invention. Similar items to those shown in previous figures have similar 
numbers and will not further be described. The second embodiment illustrates an 
ultrasound 2, and an X-Ray 138 to be used in cooperative operation according to the 
present invention. The X-Ray imaging device comprises X-Ray main unit 140 and 
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X-Ray scanning head 142 including emitter 142' and detector 142'. X-Ray scanning 
head 142 is mounted on a movable and adjustable arm 144. Bed 24 may or may not be 
part of X-Ray imaging device 138. 

Position measuring component 30 is attached at known and fixed positions from 
X-Ray scanning head 142. Additionally, position measuring component 30 is calibrated 
to the scanning head 142 such that it is at a known position from the scanning volume 
of the X-Ray. Such calibrations can be achieved by operating according to patent 
application PCT/IL98/00631. The relative position between ultrasound transducer 
scanning beam 36 and the X-ray scanning volume 146 can be calculated as described 
in the first embodiment based on direct measurement between position measuring 
components 28 and 30. 

An additional position measuring component 84 can be placed at a reference 
location on an arm 86. This position measuring component 84 (if used) is in 
cooperative communication with position measuring components 28 and 30. Thus, the 
position of ultrasound transducer 18 and of the X-Ray scanning head 142 are measured 
with respect to the reference position similar to the calculation described in relation to 
FIG. 5b. Body 6 can be fixed so as to avoid movement during the procedure. X-Ray 
scanning head 142 is positioned in order to view target 8 in the body 6 or body volume 
at two different positions. The position of X-Ray scanning head 142 is measured with 
respect to reference position thus enabling to correlate the two images into stereo 
information in order to receive a 3D image of the scanned body 6. Algorithms for 
creating such 3D image/information from stereo 2D images/information are known to 
those skilled in the art. 
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In one exemplary use of present invention, the operator may indicate target 8 
on the image received from the X-Ray 138 for example, by marking it with a mouse 
on the display 10 (as described herein above with reference to Figs. 1-3). The relative 
position of target 8 can be calculated with respect to the reference point. Ultrasound 
transducer 18 is then applied to body volume 6 and its position is measured with 
respect to the reference position. Thus, it is possible to calculate the position of 
ultrasound scanning plane 36 with respect to the image volume received from X-Ray 
138 and target 8. 

Alternately, the body volume 6 is first imaged by ultrasound in order to 
establish a desired reference plane/volume that includes a target 8. The operator selects 
a reference plane, in accordance with the procedures detailed above. Alternately, the 
operator indicates target 8 for example by marking it on the display 10, using 
conventional marking software, as described above. Data processor 14 stores the 
position of target 8 or of reference plane with respect to the reference location. 
Ultrasound transducer 18 is then removed and the position of X-Ray scanning head 
142 is calculated with respect to reference plane or target 8. Thus, it is then possible to 
position X-Ray scanning head 142 in an optimal way at two different positions so as 
two view target 8 and afterwards produce a 3D image/information. 

Additional modalities of employing in operative cooperation ultrasound 2 and 
X-Ray 138 are similar to those described for the system illustrated in Figs, la ,4 and 
described above. 

Reference is now made to FIG. 7a and 7b, which illustrate an additional 
embodiment of the present invention. Similar items to those shown in previous figures 
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have similar numbers and will not further be described. The second embodiment 
illustrates an ultrasound 2, and an optical endoscope 150 to be used in cooperative 
operation according to the present invention. Said endoscope 150 comprising an 
endoscope head 152 with a CCD 154 (not shown in the drawing) and optical apparatus 
156 (not shown in the drawing). Endoscope head 152 can be rigid, or can be flexible. 
It is still possible to use a rigid endoscope head 152 with a mobile tip enabling to 
change the angle of view. It is also possible to use endoscope with changing field of 
view. 

Position measuring component 30 is attached at a known position with respect 
to optical endoscope head 150 and calibrated to the endoscope image 158. Position 
measuring component 28 is attached at a known position with respect to transducer 18 
and calibrated to transducer beam/image 36 as described above. If endoscope head 152 
is rigid position measuring component may be attached internally or externally at any 
fixed position with respect to endoscope head 152. If endoscope head 152 is flexible or 
has a mobile tip, position measuring component 30 is positioned at the tip of head 150. 
An example of such position measuring component is the magnetic sensor 
manufactured by Mednetix Inc. Alternately, position component 30 can be a 
combination of two different functional sub-components. A first sub-component of 
positions measuring component 30 measuring the position of the head 152 at a default 
situation (default bending or default tip position). A second sub-component of position 
measuring component 30 being attached to the flexible part of endoscope head 152 
(and preferably also to the tip) and providing indication with respect to the bending or 
movement of the flexible part with respect to said default situation. An illustrative 
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example for such a second sub-component could be a fiber optic sensor manufactured 
by Measurand Inc. Still alternately, in the case of a rigid endoscope wit mobile tip it 
can be possible to receive from the endoscope information regarding the deviation 
from the default situation. 

According to one aspect of the present invention target 8 is viewed by 
ultrasound transducer 18, and endoscope head 152 is maneuvered to view target 8 
based on guiding information received from data processor 14 (not shown in Fig. 7) 
and displayed on display 10 (not shown in Fig. 7). The guidance can be in accordance 
to the methods introduced by the assignees in above cited patent applications 
PCT/IL96/00050 or PCT/IL98/00578. 

According to another aspect of the present invention target 8 is viewed by 
transducer 18 and also by endoscope head 152. It is then possible to mark target 8 in 
the ultrasound image and calculate its position with respect to position measuring 
component 28. According to the measured relative position between position 
measuring components 30 and 28 and based on the calibration of position measuring 
component 30 to the endoscope image 158 it is possible to calculate the 3D position of 
target 8 with respect to endoscope image 158. This enables to guide an invasive tool 
towards target 8 based on endoscope image 158 from any desired angle according to 
the method and apparatus described in above cited patent applications PCT/IL96/00050 
or PCT/IL98/00578. 

According to another aspect of the present invention it is possible to receive 
depth information from the endoscope image by alternative methods without the need 
to use transducer 18. According to one alternative method a target is viewed by 
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endoscope 150 while moving the endoscope head 150 at several positions on a strait 
line around the focussed position, at least one position providing a focussed image of 
the target. According to the focussing and de-focussing of the target and according to 
the measured position of position measuring component 30 it is possible to receive the 
depth of the target in the endoscope image from algorithms known as "depth from 
focus" . According to another method endoscope head 152 is viewing a volume of 
body 6 comprising target 8 from at least two different positions enabling to implement 
3D stereo imaging. The implementation of the stereo imaging algorithm is based on 
knowing the relative position between the two or more positions of the endoscope head 
152. According to still another method it is possible to receive the depth of a target 8 
from methods known to those skilled in the art as "depth from shading" Such 
methods are described in US Patent No. 4,714,319 and US Patent No. 4,695,130 
All the above described methods can provide 3D information regarding the 
position of target 8 in the image produced by endoscope 150. It is therefore possible to 
attach an additional position measuring component to an invasive tool and guide it to 
target 8 assisted by endoscope imaging in accordance to the methods described in 
guidance methods according to above cited patent applications PCT/IL96/00050 or 
PCT/IL98/00578. 

While the invention has been described with respect to several preferred 
embodiments, it will be appreciated that these are set forth merely for purposes of 
example, and that many variations, modifications and applications of the invention may 
be made. Accordingly, the scope of the invention is defined by the claims, which 
follow. 
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CLAIMS 

1 . A method enabling free of predefined mechanical constraints cooperative 
operation of two or more medical imaging devices useful in medical diagnosis and/or 

5 medical therapy planning and/or medical intervention planning and/or medical therapy 
and/or medical intervention and/or medical procedures, the method comprising the 
steps of: 

imaging a body volume/plane with a first medical imaging device; 

sensing the position of a second medical imaging device with respect to 
io said first medical imaging device by means of a position measuring system 

comprising position measuring controller and position measuring components; 

scanning part or all of said body volume/plane with said second medical 
imaging device; 

calculating the relative position of said second medical imaging device 
15 and/or relative position of the scanning plane/volume produced by said second 

medical imaging device with respect to said first medical imaging device and/or 
with respect to the scanning plane/volume produced by said first medical 
imaging device; 

displaying on at least one display screen said calculation in a cooperative 
20 way to the medical operator. 

2. The method according to claim 1 where said first and said second medical 
imaging devices operate sequentially. 
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3. The method according to claim 1 where said first and said second medical 
imaging devices operate simultaneously and/or intermittently. 

4. The method of claim 1 where said one first and said one second medical imaging 
device are one of the group X-Ray, CT, MRI or ultrasound, endoscope. 

5. The method of claim 1 where the position measuring system is from the group: 
magnetic, optic, acoustic, inertial, fiber optic or a combination of the above. 

6. The method of claim 1 where the step of sensing the position of second medical 
imaging device with respect to said first medical imaging device is performed by 
means of wired or wireless communication. 

7. The method according to claim 1 where the position of the scanning 
plane/volume/image produced by said second medical imaging device is calculated 
with respect to the scanning plane/volume/image produced by said first medical 
imaging device. 

8. The method according to claim 1 where the scanned plane/volume produced by 
said first medical imaging device is correlated and/or fused by image processing tools 
with the scanned plane/volume/image produced by said second medical imaging 
device. 

9. The method according to claim 1 further comprising the step of indicating to said 
position sensing system the position of a target by marking said target on said at least 
one display screen or by automatic recognition of the target in the image. 
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10. The method according to claim 1 further comprising the step of indicating to 
said position sensing system the position of a reference plane/volume by marking said 
reference plane/ volume on said at least one display screen. 

11. The method according to any of the claims 9 or 10 , where the position of the 
said second medical imaging device is calculated with respect to said target and/or said 
reference plane/volume/image. 

12. The method according to claim 1 where the position of the scanning 
plane/volume produced by said one second medical imaging device is calculated with 
respect to said target and/or said reference plane/volume. 

13. The method according to claim 1 and further comprising the step of indicating 
on said at least one display screen the actual progressive motion of said second medical 
imaging device towards said target and/or reference plane/ volume. 

14. The method according to claim 1 and further comprising the step of indicating 
on said at least one display screen the deviation of said second medical imaging device 
or scanning plane/volume produced by said second medical imaging device from said 
target and/or from said reference plane/ volume. 

15. The method according to claim 1 and further comprising the step of adjusting 
the position of said second imaging device so as to cause it to include in its scan 
plane/volume/image said target or to cause that its scan plane/volume coincide with 
said reference plane/volume. 

16. The method according to claim 1 and further comprising the step of correlating 
the calculated position of at least on target or the relative position between several 
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targets/points in order to assess internal anatomic movements between different stages 
of a medical procedure. 

17. Apparatus enabling free of predefined mechanical constraints cooperative 
operation of two or more medical imaging devices useful in medical diagnosis and/or 

5 medical therapy planning and/or medical intervention planning and/or medical therapy 
and/or medical intervention and/or medical procedures, apparatus comprising: 
one first medical imaging device; 
one second medical imaging device; 

a position measuring system comprising at least the following: a position 
io sensing controller and at least one first position measuring component at a 

known position with respect to said first medical imaging device and second 
position measuring component at a known position with respect to said second 
medical imaging device; 

a data processor for receiving data from the position sensing controller for 
15 calculating the relative position of said second medical imaging device and/or 

relative position of the scanning plane/volume produced by said second medical 
imaging device with respect to said first medical imaging device and/or with 
respect to the scanning plane/volume produced by said first medical imaging 
device, said data processor displaying on at least one display screen said 
20 calculation in a cooperative way to the medical operator. 

18. Apparatus according to claim 17 where the at least one display screen is one. 

19. Apparatus according to claim 17 where said first and said second medical 
imaging device operate simultaneously and/or intermittently. 
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20. Apparatus of claim 17 where said first and said second medical imaging devices 
are one of the group X-Ray, CT, MRI, ultrasound or endoscope. 

21. The apparatus of claim 17 where the position measuring system is from the 
group: magnetic, optic, acoustic, inertial, fiber optic or a combination of the above. 

5 22. Apparatus of claim 17 where the step of sensing the position of said second 
medical imaging device with respect to said first medical imaging device is performed 
by means of wired or wireless communication. 

23. Apparatus according to claim 17 where said at least one first position 
measuring component is attached onto said first medical imaging device. 

10 24. Apparatus according to claim 17 where said at least one second position 
measuring component is attached onto said second medical imaging device. 

25. Apparatus according to claim 17 where said at least one first position 
measuring component and said at least one second position measuring component work 
in operative communication. 

15 26. Apparatus according to claim 17 where said calculation is based on the direct 
measurement of the relative position between said at least one first position measuring 
component and said at least one second position measuring component. 

27. Apparatus according to claim 17 where said calculation is based on directly 
measuring the position of said at least one first position measuring component with to 
20 said at least one second position measuring component. 
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28. Apparatus according to claim 17 where said position measuring system 
additionally comprises at least one third reference position measuring component being 
placed at a first reference location; 

said at least one third position measuring component being in operative 
communication with said at least one first position measuring component and 
said at least one second position measuring component and enabling to 
calculate the relative position between them. 

29. Apparatus according to claim 37 where the scanned plane/ volume produced by 
said at least one first medical imaging device is correlated and/or fused by image 
processing tools with the scanned plane/volume produced by said at least one second 
medical imaging device. 

30. Apparatus according to claim 17 and further comprising the step of correlating 
the calculated position of at least on target or the relative position between several 
targets/points in order to assess internal anatomic movements between different stages 
of a medical procedure. 

31. Apparatus according to claim 17 further comprising the step of indicating to 
said position sensing system the position of a target by marking said target on said at 
least one display screen or by automatic recognition from the image.. 

32. Apparatus according to claim 17 further comprising the step of indicating to 
said position sensing system the position of said reference plane/ volume by marking 
said reference plane/volume on said at least one display screen. 
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33. Apparatus according to any of the claims 31-32, where the position of the said 
at least one second medical imaging device is calculated with respect to said target 
and/or said reference plane/ volume. 

34. Apparatus according to claim 17 where the position of the scanning 

5 plane/volume produced by the said at least one second medical imaging device is 
calculated with respect to said target and/or said reference plane/volume. 

35. Apparatus according to claim 17 and further comprising the step of indicating 
on said at least one display screen the actual progressive motion of said at least one 
second medical imaging device towards said target and/or reference plane/volume. 

10 36. Apparatus according to claim 17 and further comprising the step of indicating 
on said at least one display screen the deviation of said at least one second medical 
imaging device or scanning plane/volume produced by said at least one second medical 
imaging device from said target and/or from said reference plane/volume. 

37. Apparatus according to claim 17 and further comprising the step of correlating 
is the calculated position of at least on target or the relative position between several 

targets/points in order to assess internal anatomic movements between different stages 
of a medical procedure. 

38. Apparatus enabling to guide an invasive tool towards a target visible by 
endoscope means, in a free of predefined mechanical constraints cooperative operation 

20 comprising: 

an endoscopic imaging device; 
an invasive tool; 
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a position measuring system comprising at least the following: a position 
sensing controller and at least one first position measuring component at a 
known position with respect to said endoscope imaging device and second 
position measuring component at a known position with respect to said invasive 
5 tool; 

a data processor for receiving data from the position sensing controller for 
calculating the relative position of said invasive tool with respect to the 
image(s) produced by said first medical imaging device, said data processor 
displaying on at least one display screen said calculation in a cooperative way 
10 to the medical operator. 



32 



WO 00/57767 



PCT/ILOO/00202 



1/8 



10. 



DISPLAY 



12 



33 



L 



17 



ULTRASOUND 



DATA PROCESSOR 


IMAGE 
PROCESSOR 


POSITION 
SENSING 
CONTROLER 



34 
27 




1 

/ 



30 29 r /22 




28 



18. 

8-\ / >m^ 



14 



26 



-32 
-31 



r 




16 



15 



FIG.1A 



38 



n 





FIG.1B 



SUBSTITUTE SHEET (RULE 26) 




SUBSTITUTE SHEET (RULE 26) 



t 



WO 00/57767 



PCT/IL00/00202 



3/8 



o 

F 
F 
L 
I 

N 

E 



CALCULATE THE POSITION OF THE ULTRASOUND 
SCANNING BEAM WITH RESPECT TO POSITION 
MEASURING COMPONENT 28 

— - - P.M.C.28 P.M.C.28 
VECTOR d [M] 

US.S.B US.S.B 



ORIENTATION 
MATRIX 



VECTOR 



CALCULATE THE POSITION OF THE CT 
SCANNING BEAM WITH RESPECT TO POSITION 
MEASURING COMPONENT 30 

P.M.C.30 r ... P.M.C.30 ORIENTATION 



CT.S.B 



[M] 



CT.S.B 



MATRIX 



1 



MEASURE THE POSITION OF POSITION MEASURING 
COMPONENT 30 WITH RESPECT TO POSITION 
MEASURING COMPONENT 28 

P.M.C.28 P.M.C.28 ORIENTATION 



VECTOR 



P.M.C.30 



[M] 



P.M.C.30 



MATRIX 



CALCULATE THE POSITION OF THE CT SCANNING BEAM 
WITH RESPECT TO THE ULTRASOUND SCANIMG BEAM 



VECTOR 



US.S.B 
CT.S.B 

P.M.C.30 



[M] 



US.S.B 



[M] US - S - B =[M] 
L CT.S.B CT.S.B 



--US.S.B . P.M.C.28 
d = [M 

CT.S.B US.S.B 



[M] 



CT.S.B 

P.M.C.28 
P.M.C.30 ° 



([M] 



ORIENTATION 
MATRIX 

P.M.C.28 \ T 
US.S.B / 



].([M] 



P.M.C.28\ T —P.M.C.30 



P.M.C.30 



CT.S.B 



+ [M] 



P.M.C.28 



US.S.B 



-^-P.M.C.28 _ — P.M.C28 
P.M.C.30 US.S.B 



FIG.2B 



SUBSTITUTE SHEET (RULE 26) 




SUBSTITUTE SHEET (RULE 26) 



• 



WO 00/57767 



PCT/ILOO/00202 



5/8 



O 



LU LU 
> X 



LU 



CO 



3 .— 



LU O ^ 



CD 



ct ->. 

p 



CM 
CD 









> 


LU 






X 




1 


h- 


CO 


LU 




BEAM 


C£ 
LU 


WEE 


X 


! — 
LU 


o 


h- 

LU 


00 




LAT 


ION 


ANI 


ZD 


i — 




CJ 


CO 


CO 


—J 


o 




< 


CL 





CD 
CD 










o 


< 






O 






Q 






LU 


m 

UJ 






o 






U_ 




=3 




< 


Q 






UJ 


LU 


o 


O 


X 




o 


h— 

>- 
I 


ADDI 


PR 


CL 






CL 


o 




< 


i— 










UJ 2 


UJ ^ 




> o 


IMAG 
FORI 
I.I.D 




Fl AT 

L. LrA 1 

OSITI 









< 
o 



CC UJ 




PUTE 
ET(S) 
ITION 


< o 
< 


ONAL) | 


COM 
- TARG 
POS 



CM 

o 



CO 

o 



CL ' 
O ™ 



J — 

CL 
O 



y 



co ^ uj 



u 0 9j 

^ z < 
a: g < o 

co^ < 

o S z 

0- < 



o 

CN 



SUBSTITUTE SHEET (RULE 26) 



WO 00/57767 



PCT71L00/00202 




SUBSTITUTE SHEET (RULE 26) 



WO 00/57767 



PCT/IL00/00202 




SUBSTITUTE SHEET (RULE 26) 



WO 00/57767 PCT/ILOO/00202 




FIG.7A 




FIG.7B 



SUBSTITUTE SHEET (RULE 26) 



